AMENDMENTS TO THE CLAIMS 

Claims Pending: 

• At time of the Action: Claims 1-55 

• Amended Claims: Claims 1, 7, 9, 10, 14, 15, 17, 21, 25, 26, 28, 32, 37, 38, 44, and 46 

• After this Response: Claims 1-55 

The following listing of claims replaces all prior versions and listings of claims in the 
application. 

L (Currently Amended) A method for face modeling and identification of facial 
features, comprising: 

matching determining outer and inner facial features of a face model with; 

initializing outer and inner facial features of the face model by taking images of a face 
to correspond to: 

that of a first model for a first face image of the face in a frontal position ; and 
that of a second model for a second face image of the face moving in a yaw 
direction, wherein the first and the second face images are pictures taken at 
substantially the same respective camera orientation ; and 
matching outer and inner facial features by a correlation between the first face image 

and the second face image; 

adjusting each -said the matching outer and inner facial features of the first and the 

second models using the corresponding epipolar constraint for the first and the_second models 

for a more accurate correlation of facial features between the first face image and the second 

face image; and 
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identifying facial features for face recognition. 



2. (Original) The method as defined in Claim 1 , wherein: 

the inner facial features comprise a nose, a mouth and a pair of eyes; and 
the outer facial features comprise an arcuate bottom edge of the face and a pair of 
eyebrows. 

3. (Original) The method as defined in Claim 1, wherein a plurality points 
correspond to each said inner facial feature and comprise: 

a plurality of mouth comers corresponding to the mouth; 
a plurality of eyes comers corresponding to the eye; and 
a nose tip corresponding to the nose. 

4. (Original) The method as defined in Claim 1, wherein the first and second face 
images are the same face captured at the substantially the same respective camera orientation. 

5. (Original) The method as defined in Claim 4, wherein the respective face poses 
of the first and second face images are: 

substantially the same as to pitch; 
substantially the same as to roll; and 

different as to yaw in a range from about 3 degrees to about 10 degrees. 
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6. (Original) The method as defined in Claim 1, wherein the first and second face 
images are pictures taken at the substantially the same respective camera orientation of the 
same face in substantially the same face pose range but differing by the yaw. 

7. (Currently Amended) The method as defined in Claim 1 , wherein the face pose 
range differs in the first and second face images by a yaw different difference of not more 
than about ten degrees (10°). 

8. (Original) The method as defined in Claim 1 , wherein: 
the first face image is a full frontal picture of a human face; and 

the second face image differs from the first face image by a yaw of not more than 
about ten degrees (10°). 

9. (Currently Amended) The method as defined in Claim 1, further comprising 
outputting a representation of each of the first and second models, each including the 
respective inner and outer facial features., thereof 

10. (Currently Amended) The method as defined in Claim 9, wherein the 
outputting further comprises: 

repeating the matching and the adjusting until each said match of the outer and inner 
facial features on: 

the first model is not greater than a predetermined convergence toleration with respect 
to that of the face model; and 
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the second model is not greater than a predetermined convergence toleration with 
respect to that of the face model. 

1 1 . (Original) The method as defined in Claim 1 , further comprising repeating the 
matching and the adjusting until each said match of the outer and inner facial features on: 

the first model is not greater than a predetermined convergence toleration with respect 
to that of the face model; and 

the second model is not greater than a predetermined convergence toleration with 
respect to that of the face model. 

12. (Original) The method as defined in Claim 1, further comprising identifying 
the face of a person in a database that matches at least one of the first and second face images 
by using the respective outer and inner facial features of the first and second models. 

13. (Original) A computer readable medium comprising instructions that, when 
executed, perform the method of Claim 1 . 

14. (Currently Amended) A method comprising: 

matching determining outer and inner facial features of a face model, each being 
represented by plurality of points, w i fe ; 

initializing outer and inner facial features of the face model by taking images of a face 
to correspond to: 

that of a first model for a first face image of the face in a frontal position ; and 
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that of a second model for a second face image of the same face moving in a 
yaw direction ; 

matching outer and inner facial features by a correlation between the first face image 
and the second face image; 

adjusting the plurality of points for each said matching outer and inner facial features 
of the first and second models using the corresponding epipolar constraint for the first and 
second models for a more accurate correlation of facial features between the first face image 
and the second face image ; and 

repeating the matching and the adjusting until: 

a majority of the points for each of the outer and inner facial features on the first 
model that matches that of the face model has a relative offset there between of not greater 
than a predetermined convergence toleration; and 

a majority of the points for each of the outer and inner facial features on the first 
second model that matches that of the face model has a relative offset there between not 
greater than the predetermined convergence toleration; 

outputting the first and the second model that has a relative offset there ; and 

identifying facial features for face recognition. 

15. (Currently Amended) The method as defined in Claim 14, further comprising 
outputting a representation of each of the first and second models, each including the 
respective inner and outer facial features, thereof 

16. (Original) The method as defined in Claim 14, wherein: 
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the inner facial features comprise a nose, a mouth and a pair of eyes; and 
the outer facial features comprise an arcuate bottom edge of the face and a pair of 
eyebrows. 

17. {Currently Amended) The method as defined in Claim 14, wherein the 
plurality points and corresponding said inner facial features are selected from the group 
consisting of: 

a plurality of mouth corners corresponding to a mouth; 
a plurality of eyes corners corresponding to an eye; and 
a nose tip corresponding to a nose. 

18. (Original) The method as defined in Claim 14, wherein the first and second 
face images are the same face captured at the substantially the same respective camera 
orientation. 

19. (Original) The method as defined in Claim 18, wherein the respective face 
poses of the first and second face images are: 

substantially the same as to pitch; 
substantially the same as to roll; and 

different as to yaw in a range from about 3 degrees to about 10 degrees. 



RESPONSE TO OFFICE ACTION DATED OCTOBER 31 , 2006 



7 of 22 



ATTORNEY DOCKET NO. MS !- 1 523US 
Serial No, IO/6!0,494 



20. (Original) The method as defined in Claim 14, wherein the first and second 
face images are pictures taken at the substantially the same respective camera orientation of 
the same face in substantially the same face pose range but differing by the yaw. 

21. (Currently Amended) The method as defined in Claim 14, wherein the face 
pose range differs in the first and second face images by a yaw different difference of not 
more than about ten degrees (10°). 

22. (Original) The method as defined in Claim 14, wherein: 
the first face image is a full frontal picture of a human face; and 

the second face image differs from the first face image by a yaw of not more than 
about ten degrees (10°). 

23. (Original) The method as defined in Claim 14, further comprising identifying 
the face of a person in a database that matches at least one of the first and second face images 
by using the points that respectively correspond to the outer and inner facial features of the 
first and second models. 

24. (Original) A computer readable medium comprising instructions that, when 
executed, perform the method of Claim 14. 

25. (Currently Amended) A method comprising the steps of: 
determining outer and inner facial features of a face model: 
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{a) initializing, using a face model having outer and inner facial features wherein 
each of the outer and inner facial features i ncluding includes a plurality of_points, first and 
second models for respective first and second face images, wherein each of the first and 
second models has out e r and inner facial featur e s each including a plurality points a first 
model is for a first image of a face in a frontal position and a second model is for a second 
image of the face moving in a yaw direction : 

(b) estimating a fundamental matrix for the first and second models; 

(e) updating the plurality of points for each saM inner facial features of the first 
and second models by using the respective local texture for each said point; 

(d) updating each said inner I'acial features of the first and second models; 

f» updating, using the fundamental matrix and the corresponding epipolar 
constraint, the plurality of points for each of the inner facial features of the first and second 
models; and 

(f) updating each said outer facial features of the first and second models 

i£i wherein the updating is for a more accurate correlation of facial features 

between the first face image and the second face image; and 

identifying facial features for facial recognition. 



26. (Currently Amended) The method as defined in Claim 25, wherein the steps 
further comprise: 

(g) if the first model has converged within a predetermined tolerance of the face 
model, outputting a representation of the inner and outer facial features of the first model, 
otherwise repeating the four updating steps (c) through (f) for the first model; and 
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(b) if the second model has converged within a predetermined tolerance of the face 
model, outputting a representation of the inner and outer facial features of the second model, 
otherwise repeating the four updating steps (c) through (f) for the second model. 

27. (Original) The method as defined in Claim 25, wherein: 

the inner facial features comprise a nose, a mouth and a pair of eyes; and 
the outer facial features comprise an arcuate bottom edge of the face and a pair of 
eyebrows. 

28. (Currently Amended) The method as defined in Claim 27, wherein the 
plurality of points corresponding to the inner facial features of: 

the mouth comprises a plurality of mouth corners; 
each said eye comprises a plurality of eyes corners; and 
the nose comprises a nose tip. 

29. (Original) The method as defined in Claim 25, wherein the first and second 
face images are the same face captured at the substantially the same respective camera 
orientation. 

30. (Original) The method as defined in Claim 29, wherein the respective face 
poses of the first and second face images are: 

substantially the same as to pitch; 
substantially the same as to roll; and 
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different as to yaw in a range from about 3 degrees to about 10 degrees. 

31. (Original) The method as defined in Claim 25, wherein the first and second 
face images are pictures taken at the substantially the same respective camera orientation of 
the same face in substantially the same face pose range but differing by the yaw. 

32. (Currently Amended) The method as defined in Claim 25, wherein the face 
pose range differs in the first and second face images by a yaw different difference of not 
more than about ten degrees (10°). 

33. (Original) The method as defined in Claim 25, wherein: 
the first face image is a full frontal picture of a human face; and 

the second face image differs from the first face image by a yaw of not more than 
about ten degrees (10°). 

34. (Original) The method as defined in Claim 25, wherein the local texture for 
each said point comprises photometric data at or proximal to the point. 

35. (Original) The method as defined in Claim 25, further comprising identifying 
the face of a person in a database that matches at least one of the first and second face images 
by using, respectively, the output representation of the inner and outer facial features of: 

the first model; and 
the second model. 
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36. (Original) A computer readable medium comprising instructions that, when 
executed, perform the method of Claim 25. 

37. (Currently Amended) An apparatus comprising: 
memory including: 

one or more programs; 

outer and inner facial features of a face model, each being represented by a plurality of 

points; 

a first face imag e of a face in a frontal position ; and 

a second face image of the face moving in a yaw direction ; 

one or more processors configured to execute the one or more programs in the 
memory se-as to perform steps including actions comprising: 

match the plurality of points of the outer and inner facial features of the face model 

with: 

that of a first model for the first face image of the face in the frontal position; and 
that of a second model for the second face image of the face moving in a yaw 
direction ; 

adjust the plurality of points for each said matching outer and inner facial features of 
the first and the second models using the corresponding epipolar constraint for the first and 
the second models for a more accurate correlation of facial features between the first face 
image and the second face image; 

repeat the match and adjust steps until: 
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a majority of the points for each of the outer and inner facial features on the first 
model that matches that of the face model has a relative offset there between of not greater 
than a predetermined convergence toleration; and 

a majority of the points for each of the outer and inner facial features on the first 
second model that matches that of the face model has a relative offset there between not 
greater than the predetermined convergence toleration ; and 

a monitor to display the facial features for face recognition. 

38. (Currently Amended) The apparatus as defined in Claim 37, wherein the steps 
further comprise outputting a representation of each of the first and second models, each 
including the respective inner and outer facial features, ther e of 

39. (Original) The apparatus as defined in Claim 37, wherein: 

the inner facial features comprise a nose, a mouth and a pair of eyes; and 
the outer facial features comprise an arcuate bottom edge of the face and a pair of 
eyebrows. 

40. (Original) The apparatus as defined in Claim 37, wherein the plurality points 
and corresponding said inner facial feature are selected from the group consisting of: 

a plurality of mouth corners corresponding to a mouth; 
a plurality of eyes corners corresponding to an eye; and 
a nose tip corresponding to a nose. 



Lee & Hayes, pllc 

RESPONSE TO OFFICE ACTION DATED OCTOBER 3 1 . 2006 



13 of 22 



ATTORNEY DOCKET NO. MS I -1523US 
ScrialNo. 10/610,494 



41. (Original) The apparatus as defined in Claim 37, wherein the first and second 
face images are the same face captured at the substantially the same respective camera 
orientation. 

42. (Original) The apparatus as defined in Claim 41, wherein the respective face 
poses of the first and second face images are: 

substantially the same as to pitch; 
substantially the same as to roll; and 

different as to yaw in a range from about 3 degrees to about 10 degrees. 

43. (Original) The apparatus as defined in Claim 37, wherein the first and second 
face images are pictures taken at the substantially the same respective camera orientation of 
the same face in substantially the same face pose range but differing by the yaw. 

44. (Currently Amended) The apparatus as defined in Claim 37, wherein the face 
pose range differs in the first and second face images by a yaw diff e r e nt difference of not 
more than about ten degrees (10°). 

45 . (Original) The apparatus as defined in Claim 3 7, wherein: 
the first face image is a full frontal picture of a human face; and 

the second face image differs from the first face image by a yaw of not more than 
about ten degrees (10°). 
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46. (Currently Amended) An apparatus comprising: 

means for initializing, using a face model having outer and inner facial features each 
including a plurality of_points, first and second models for respective first and second face 
images, wherein each of tho first and second models has outer and inner facial features each 
including a plurality points; a first model is for a first face image of a face in a frontal position 
and a second model is for a second face image of the face moving in a yaw direction : 

means for ge nerating the first face image and the second face image with a camera: 

means for estimating a fundamental matrix for the first and second models; 

means for updating the plurality of points for each said inner and outer facial feature 
of the first and second models by using the respective local texture for each said point; 

means for updating each said inner facial feature of the first and second models; 

means for updating, using the fundamental matrix and the corresponding epipolar 
constraint, the plurality of points for each of the inner facial features of the first and second 
models; and 

means for updating, using the plurality of points for each of the inner facial features of 
the first and second models, each said outer facial feature of the first and second models. 

wherein the updating is for a more accurate correlation of facial features between the 
first face image and the second face image; and 

means for displaying on a monitor used for facial recognition. 

47. (Original) The apparatus as defined in Claim 46, further comprising: 

means, if a majority of the points for each of the outer and inner facial features on the 
first model that matches that of the face model has a relative offset there between of not 
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greater than a predetermined convergence toleration, for outputting a representation of the 
inner and outer facial features of the first model; and 

means, if a majority of the points for each of the outer and inner facial features on the 
first model that matches that of the face model has a relative offset there between not greater 
than the predetermined convergence toleration, for outputting a representation of the inner and 
outer facial features of the second model. 

48. (Original) The apparatus as defined in Claim 46, wherein: 

the inner facial features comprise a nose, a mouth and a pair of eyes; and 
the outer facial features comprise an arcuate bottom edge of the face and a pair of 
eyebrows. 

49. (Original) The apparatus as defined in Claim 48, wherein the plurality points 
corresponding to the inner facial feature of: 

the mouth comprises a plurality of mouth corners; 
each said eye comprises a plurality of eyes corners; and 
the nose comprises a nose tip. 

50. (Original) The apparatus as defined in Claim 46, wherein the first and second 
face images are the same face captured at the substantially the same respective camera 
orientation. 
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51. (Original) The apparatus as defined in Claim 46, wherein the respective face 
poses of the first and second face images are: 

substantially the same as to pitch; 
substantially the same as to roll; and 

different as to yaw in a range from about 3 degrees to about 10 degrees. 

52. (Original) The apparatus as defined in Claim 46, wherein the first and second 
face images are pictures taken at the substantially the same respective camera orientation of 
the same face in substantially the same face pose range but differing by the yaw. 

53. (Original) The apparatus as defined in Claim 46, wherein the face pose range 
differs in the first and second face images by a yaw different of not more than about ten 
degrees (10°). 

54. (Original) The apparatus as defined in Claim 46, wherein: 
the first face image is a full frontal picture of a human face; and 

the second face image differs from the first face image by a yaw of not more than 
about ten degrees (10°). 

55. (Original) The apparatus as defined in Claim 46, wherein the local texture for 
each said point comprises photometric data at or proximal to the point. 
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